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ABSTRACT 

Aims. The Lyo- luminosity function (LF) of high-redshift Lya- emitters (LAEs) is one of the few observables of the re-ionization epoch 
accessible to date with 8-10 m class telescopes. The evolution with redshift allows one to constrain the evolution of LAEs and their 
role in re-ionizing the Universe at the end of the Dark Ages. 

Methods. We have performed a narrow-band imaging program at 1.06 fim at the CFHT, targeting Lya emitters at redshift z ~ 7.7 in 
the CFHT-LS Dl field. From these observations we have derived a photometric sample of 7 LAE candidates at z ~ 7.7. 
Results. We derive luminosity functions for the full sample of seven objects and for sub-samples of four objects. If the brightest 
objects in our sample are real, we infer a luminosity function which would be difficult to reconcile with previous work at lower 
redshift. More definitive conclusions will require spectroscopic confirmation. 

Key words, cosmology: early Universe - galaxies: luminosity function, mass function - galaxies: high-redshift 



1. Introduction 

Searching for high-redshift galaxies is one of the most active 
fields in observational cosmology. The most distant galaxies pro- 
vide a direct probe of the early stages of galaxy formation in ad- 
dition to revealing the effects of cosmic re-ionization (Fan et al. 
2006). Galaxies at redshift 6 are routinely found and show that 
star formation was initiated at significantly higher redshifts and 
that these galaxies are the likely sources of the re-ionization of 
the universe which was completed at this redshift. Conversely, 
detection of z > 7 galaxies is still rare, due in large part to 
the complete absorption of their restframe UV emission below 
the Lya line which is redshifted beyond the 1 fim cutoff wave- 
length of silicon. The deployment of large format IR arrays at 
many telescopes now makes these observations possible. From 
Z = 6.5 to z = 7.7 light dimming due to luminosity distance 
is 30% and the age of the Universe varies by 150 Myr, lead- 
ing to a further dimming, probably moderate considering the 
relatively short time span, of the galaxy intrinsic luminosities. 
Observations of z > 7 objects should therefore remain within 
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reach of the current generation of telescopes. However, at z > 6.5 
the Universe is thought to be undergoing re-ionization and this 
may cause a further evolution of the observable properties of 
very distant objects with redshift, possibly more abrupt than their 
intrinsic evolution and dimming with age and distance. 

One prime tracer of high-redshift galaxies is the Lyo- line. 
The determination of the Lya Luminosity Function (LF) with 
infrared arrays is actively pursued by several groups, either 
through narrow-band imaging (e.g Wil lis et al.|20 08 1 Cuby et al. 
|2007[ ), or through blind spectroscopy along the critical lines of 
galaxy clusters used as gravitational telescopes (Richard et al. 
[2006] |Stark et al.||2007j |Bouwens et al~||2008] i. High-z galax- 
ies are also searched using the dropout technique between the 
optical and near infrared domains, either in the field (see e.g. 
Bouwens et al.|2009 1 or behind galaxy clusters (see e.g. Richard 
et al.||2008| l. The dropout method is primarily sensitive to the 
UV continuum emission of the galaxies and therefore allows to 
determine their UV Luminosity Function (UVLF). 

The UVLF of LAEs is a direct tracer of galaxy evolution and 
it is not affected by the amount of neutral hydrogen in the inter- 
galactic medium (IGM), while the Lya emission (and therefore 
the Lyor LF) may be affected. A rapid change in the ionization 
state of the Universe could lead to a decline of the Lycr lumi- 
nosity density at high-redshift, while the UVLF should have a 
milder evolution. Evidence for such a rapid change of the neu- 
tral fraction of the Intergalactic Medium between redshifts 6 and 
7 includes the observation of LAEs in narrow-band imaging at 
z = 6.5 ( |Kashikawa et al.|[20Q6ll and at z = 7 ([Ota et al.|[2 008 ) 
and in spectroscopy at z > 7 ( |Richard et al.|2008 1. The patchy 
structure of a partially ionized Universe should also affect the 
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apparent clustering of LAEs at high redshifts, see |Mesinger &| 
Furlanetto ( 2008| > for an analysis of this effect at z ~ 9. 

More observations of LAEs at high redshifts are necessary to 
better characterize the re-ionization epoch, and in particular ob- 
servations in the near-IR domain to probe redshifts ^ 7. Willis & 
Courbin| ( [2005) , |Wmis et al.| ( p008] l and |Cuby et aT] ( [20071 1 hay e 
performed narrow-band surveys at z = 8.8 which have yielded 
only upper limits of the Lya LF of LAEs at this redshift. In this 
paper we present the results of a narrow-band imaging survey at 
z = 7.7 representing a factor of 10 improvement in area at ap- 
proximately the same detection limit compared to our previous 
survey at z = 8.8. These observations were made with the Wide 
Field near-IR Camera (WIRCam) operating at CFHlQ 

In section 2, we describe the narrow-band observations and 
other observational material used in this paper. In section 3, 
we discuss the construction of our sample of Lya emitters. In 
section 4, we infer from this sample an estimate of the Lya 
luminosity function of z = 7.7 LAEs and discuss it in the light 
of existing models. 

Unless explicitly stated otherwise, we use AB magnitudes 
throughout the paper. We assume a flat ACDM model with Q M = 
0.27 and H = 70 km s" 1 Mpc" 1 . 

2. Observational data 

The CFHT-LS Dl field was chosen for the availability of multi- 
wavelength data from the X ray to the near-IR, including in par- 
ticular extremely deep optical data from the CFHT-LS survey. 
For the purpose of this study, we originally made use of the so- 
called T0004 release of the CFHT-LS survey, and later of the 
T0005 release when it became available (November 2008). The 
CFHT-LS data products are available from the CADC archive to 
CFHT users and consist in various image stacks in the u*g'r'i'z' 
filters and of ancillary data, such as weight maps, quality checks, 
catalogs, etc. The u*, g', r', /', z' filters have spectral curves sim- 
ilar to the SDSS filters. 

The core data relevant to this paper are deep near-IR Narrow 
Band (NB) observations of a ~ 20' x 20' area of the CFHT-LS 
Dl Deep Field, totalling ~ 40 hrs of integration time. In addition 
to the narrow-band near-IR data we made use of broad band J, H 
and Ks data of the field which were acquired as part of another 
program carried out with WIRCam (Pis Willott & Kneib). We 
also used near-IR Spitzer/IRAC data from the SWIRE survey 
( |Lonsdale et al.|2003) . 

A summary of the observational data used in this paper is 
provided in table [T] Figure [T] shows the transmission curves of 
the filters corresponding to the multi-band data used in this pa- 
per. 

2.1. WIRCam narrow-band data 

WIRCam is a ~ 20' x 20' imager installed at the CFHT prime 
focus. It is equipped with 4 Hawaii2-RG arrays, the pixel scale is 
0.3" pixel and the four arrays are separated by a ~ 15" gap. We 
used a Narrow Band filter centered at 1 .06 fim (hereafter referred 
to as NB1060) with a full width at half maximum of 0.01 /.im (~ 
1%). This filter was designed to match a region of low night sky 
OH emission. 

The data were acquired in service mode over several months 
in two different semesters in 2005 and 2006, each epoch totalling 
approximately the same integration time (~ 20 hrs). A detector 
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Fig. 1. Transmission curves of the filters corresponding to the 
data used in this paper. All transmissions are normalized to 
100% at maximum. 



integration time of 630 s was used, ensuring background limited 
performance. The sky background was measured to be of the 
order of 4e~ s _1 pixeL 1 which corresponds to a sky brightness 
of ~ 17.7 mag arcsec -2 (Vega). Our first observations started 
shortly after the commissioning of the camera. The detector was 
experiencing variable readout noise and significant electronic 
crosstalk, both issues that were progressively solved in the sub- 
sequent months of operations. The first year data were the most 
affected. We discuss in a subsequent section of this paper the 
effects of the electronic cross-talk as a possible source of con- 
tamination. 

With WIRCam the only possibility to guide the telescope is 
through the on-chip guiding capability implemented in the de- 
tector controller. This is achieved by clocking adequately small 
detector windows around bright stars for fast readout and rapid 
guiding. This feature does also leave some residuals on the im- 
ages along the detector lines where the windows are located. 

The narrow-band data were pre-processed at CFHT (dark 
subtraction and flat fielding). The pre-processed images were 
then stacked together at the Terapix data processing center at 
Institut d' Astrophysique de Paris (IAP). The data reduction steps 
include double pass sky subtraction, astrometric and photometric 
calibration and final stacking of the images. Two separate stacks 
were produced for each of the one-year datasets. For the details 
of the data reduction, see Marmo (2007). We further combined 
these two stacks into a single stack corresponding to the entire 
dataset. After stacking, the useful area of the array after removal 
of the edges was 390 arcmin 2 . The FWHM image quality of the 
final stacked image, as measured on stars, is ~ 0.76". 

2.2. WIRCam Broad band data 

The broad band J and Ks WIRCam data were acquired in 2006 
and 2007 and were processed similarly to the narrow-band data. 
We also had moderately deep SOFI (ESO-NTT) J and Ks band 
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images covering one quarter of the WIRCam field ( |Iovino et al.| 
2005 ). This allowed us to improve the limiting magnitude by 
~ 0.3 mag in each of the J and Ks bands for the corresponding 
quadrant. We did not attempt at making use of the UKIDSS Deep 
Extragalactic Survey (UKIDSS-DXS) ( jLawrence et al.|2007| > J, 
H and Ks images as these data are of significantly shallower 
depths. The image quality achieved in the J and Ks image is 
comparable to that of the NBIQ6Q image. 

We note that the 7YB1060 and J WIRCam niters do not over- 
lap. The wavelengths of the blue and red ends of the full width at 
half maximum of the J filter are 1175 and 1333 nm. The J filter 
can therefore be used to trace the UV continuum above the Lya 
line without being contaminated by line emission. 

2.3. Photometric calibration 



Due to the general lack of photometric calibration data in 
narrow-band filters and to the lack of systematic observations of 
standard stars with the WIRCam NB1060 filter, we performed 
the photometric calibration of the narrow-band dataset using 
stars present in the field. For consistency we used identical pro- 
cedures for the photometric calibration of the entire MegaCam 
and WIRCam datasets. We initially selected stars on morpholog- 
ical criteria from the list of detected objects. We then selected 
those stars which were not saturated in any of our images. From 
this list of objects we finally kept those present in the 2MASS 
catalog. This led to a final stellar sample of 75 objects. We first 
determined the zero points of the WIRCam Broad Band data (J 
and Ks) by minimizing the difference between the WIRCam and 
2MASS magnitudes of the stellar sample. This left residuals of 
0.07 and 0.15 magnitudes (rms) in the J and Ks bands respec- 
tively. 

For the MegaCam data, we applied zero point offsets up to 
0.06 magnitude to the photometric catalog distributed as part of 
the T0004 CFHT-LS release. These offsets were determined by 
Ilbert et al. ( 2006 1 when trying to adjust, for the purpose of deter- 
mining photometric redshifts, the original CFHT-LS photometry 
to synthetic colors of galaxies derived from SED models. These 
offsets were originally determined for the T0003 release, and we 
used slightly modified ones corresponding to the T0004 release 
( |Coupon et al.|2008[|libert et al.|2006| l. 

As a parallel investigation, we generated synthetic colors for 
the MegaCam and WIRCam filters of a variety of stellar spectra 
models of various temperatures and metallicities (|Marigo et al. 
(2008) and http://stev.oapd.inaf.it/~lgirardi/cgi-bin/cmd). While 
the WIRCam J and Ks magnitudes of the stellar sample did 
match well to the synthetic color tracks, the CFHT-LS magni- 
tudes had to be slightly modified by offsets very similar to those 
mentioned above to better match the color tracks. This suggests 
that there are systematic offsets between the CFHT-LS photom- 
etry and synthetic colors of stars and galaxies. That the offsets 
for stars and galaxies are similar is not surprising for synthetic 
SED modeling of galaxies makes direct use of stellar spectra. 
More interesting is the fact that these offsets do not seem to de- 
pend on the models being used, as noted by Ilbert et al. (2006), 
a fact which seems re-inforced by our analysis since we used 
completely different synthetic stellar libraries. 

Finally, we performed a last check using the stellar library 
of Pickles ( Pickles|1998| >. This library consists of observed stel- 
lar spectra in the optical domain and in parts of the near-IR do- 
main, with interpolations in between. Here again the color tracks 
derived for the MegaCam filters from this library do match the 
color tracks of our stellar sample after applying the same offsets 
as above. 



From the color tracks we determined that the stars of the 
stellar sample used for the calibration have spectral types from 
G to M5. Then, from the calibrated u*, g', r', i' , z', J and Ks 
data, we performed an ad hoc polynomial fitting of the fluxes of 
all objects in the stellar sample, from which we derived for each 
star the NB1060 magnitude at 1.06 //m. This simple method is 
justified in view of the large number of photometric datapoints 
(7) available, of the smooth spectral energy distribution of stars, 
and of the absence of features at the wavelength of the NB1060 
filter in the infrared spectra of stars of spectral types earlier than 
M5. 

With the stellar NB1Q60 magnitudes, we could then deter- 
mine the zero points of our 7YB1060 image. Because quadrants 
have slightly different gains, this was done separately for each 
quadrant. The rms residuals after this last step were 0.04 magni- 
tude. 

Making provision for additional sources of errors, e.g. the 
accuracy of the 2MASS photometry, possible biases from the 
selected sample of stars, etc., we estimate our final photometric 
accuracy to be of the order of 0. 1 magnitude rms and we adopt 
this value in the rest of this paper. 

2.4. Catalog generation and detection limits 



We used SExtractor ( |Bertin & Arnouts||1996| ) in single image 
mode for object detection and photometry of the 7YB1060 and 
Broad Band WIRCam images. The magnitudes were computed 
in apertures 5 pixels (1.5") in diameter. We used the CFHT-LS 
public images of the field for the optical u*g'r'i'z' bands, photo- 
metrically corrected as explained in the previous section. 

The limiting magnitude of the 7YB1060, / and Ks WIRCam 
observations was estimated as follows: we added 200 artificial 
star-like objects per bin of 0.1 mag on the stacked 7YB1060 im- 
age in carefully selected blank regions of the image. We then 
ran SExtractor on this image using the same parameters as previ- 
ously used for object detection. Counting the number of artificial 
stars retrieved in each magnitude bin provided a direct measure 
of our completeness limit. We report in this paper the limiting 
magnitude at the 50% completeness limit. 

In the optical we re-binned the original CFHT-LS im- 
ages with O.^'pixeL 1 images to the 0.3"pixer' scale of the 
WIRCam images. We then ran Sextractor with the same param- 
eters used with the WIRCam data. We checked that the photom- 
etry before and after re-binning was preserved. We then derived 
the completeness limit at 50% for the CFHT-LS images using the 
same methodology as described above for the WIRCam images. 

In order to estimate the signal to noise ratio (SNR) of our 
candidates and the SNR corresponding to our 50% complete- 
ness limit we used the noise image (BACKGROUND_RMS) 
produced by SExtractor. This image gives for each pixel the lo- 
cal noise cr. The SNR of an object with number of counts F in 
an aperture of A pixels is given by: 

SNR = F/^fA^ (1) 
and the error on the magnitude m by: 

Am = 1. 086/5 NR (2) 

Finally, the limiting magnitude reached by the 7YB1060 observa- 
tions is 25.2 in apertures 1.5" in diameter at the 50% complete- 
ness limit. This limit corresponds to a SNR of ~ 4 and, converted 
into a pure emission line flux, to 8.3 x 10~ 18 ergs s _1 ctrT 2 . 

The same procedure was used to derive the limiting magni- 
tudes of all CFHT-LS and WIRCam images. They are reported 
in table Q] 
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Table 1. Observational data. 



Instrument 


Band 


Integration 


Limiting 






time (hrs) 


magnitude" 


MegaCam 


u* 


20.7 


27.9 


MegaCam 


g' 


25 


28.1 


MegaCam 


r' 


49 


27.8 


MegaCam 


i' 


74 


27.4 


MegaCam 


z' 


55.8 


26.5 


WIRCam 


NB 1st epoch 


20 


24.8 


WIRCam 


NB 2nd epoch 


20 


24.9 


WIRCam 


NB combined 


40 


25.2 


WIRCam 


J 


6.2 


25.0 b 


WIRCam 


H 


7.7 


24.7 


WIRCam 


Ks 


8.9 


24.7 b 


IRAC 


3.6 yum 


0.034 


22.2 


IRAC 


4.5 yum 


0.034 


21.5 



Act magnitude limits in apertures 1.5" in diameter for MegaCam 

and WIRCam. These limits correspond to a 50% completeness 

level. IRAC limiting magnitudes are 5cr in 3.8" apertures. 

In one quarter of the field, for which additional NTT/SOFI data 

were available, magnitude limits of 25.2 in J and 24.8 in Ks were 

achieved. 



3. Sample construction 

3.1. Initial candidate selection 

We started by matching all catalogs corresponding to individual 
images to the 7YB1060 catalog using a matching radius between 
positions of 0.7" to allow for astrometric errors. 

Our initial selection of Lya candidates was based on the fol- 
lowing criteria: 



u* 


-NB1060 


> 


2.7 


g' 


- 7YB1060 


> 


2.9 


;•' 


- 7VB1060 


> 


2.6 


/' 


-NB1060 


> 


2.2 


z' 


- 7VM060 


> 


1.3 



Considering the limiting magnitude of our optical and NB 
images, the selection criterion 1 above corresponds to: 



(3) 



Taken altogether, the color break between the optical and 
7YB1060 filters is extremely high and covers a wide spectral 
range. For the CFHT-LS, the Terapix data center generated deep 
X 2 images combining the g' , r' and f images. Without entering 
into considerations on wide band / multi-color magnitudes, we 
can infer from equations [3]that the optical dropout selection can 
be broadly expressed as: 



g'r'i' - 7YB1060 <: 3 



(4) 



We note that this color break is significantly stronger than 
what has been usually achieved in other high-z LAEs or LBGs 
searches, however with a slight gap in wavelength between the 
optical red end and the /YB1060 filter. 

After this initial criterion, a careful visual inspection of the 
candidates allowed us to remove a few obvious fake candidates 
in the form of electronic ghosts or artifacts around bright stars. 
A couple of objects of dubious quality in one or some of the 
images, or with unusual morphology, were also removed. 

Finally, three initial candidates that were bright in the Ks 
band image with 7YB1060 - Ks ^ 1.2 were interpreted as 
Extremely Red Objects (EROs) (see also section 3.3.6 1 and were 
therefore discarded, corresponding de facto to using an addi- 
tional color selection criterion for the candidates: 



NB\060-Ks <, 1.2 



(5) 



1. We selected objects detected in the 7YB1060 image which do 
not have counterpart in any of the optical images (u*, g', r', 
i', z'), as it is indeed virtually impossible to detect any flux 
blueward of the Lya line. Negligible amounts of radiation 
are expected to escape the galaxy and to be transmitted by 
the IGM below the z = 7.7 Lyman limit at ~ 790 nm, and 
therefore to be detected in the u*, g' and r' bands. All the 
radiation between the Lyo- and LyB lines at z = 7.7 is en- 
tirely reshifted beyond the Gunn-Peterson (GP) trough at ~ 
850 nm observed in the spectra of high-redshift quasars {Fan] 
et al.|2 006), and which corresponds to Lya absorption by the 
partially neutral IGM above z ~ 6. There should therefore be 
no detectable flux in the z' band. Moreover, all photons red- 
der than the Lyman limit at z = 7.7 are redshifted above the 
LyB and the Lya troughs at z = 6, with therefore an optical 
depth of 5 or more ( |Fan et al. 2006 ) leading to very strong 
color breaks i' — J <: 5 or more. 

2. We required that the 7YB1060 objects detected in the com- 
bined image be also detected in each of the half 7YB1060 
stacks corresponding to each epoch. While each half-stack is 
at lower SNR than the total combined image used for gener- 
ating the master 7YB1060 catalog, this criterion allows one to 
remove variable (in flux or in position) objects and reduces 
considerably the number of low SNR detections. 

3. We required a signal to noise ratio of ~ 5 or higher on the 
combined image, corresponding to a SNR ^ 3.5 in half stack 
images. 



From these simple criteria we derived an initial list of 8 objects, 
none of them being resolved at the level of the image quality of 
the NB1Q6Q image (0.76"). 

Finally, we note that none of the objects in our list do have 
counterparts in any of the Spitzer/IRAC SWIRE data. If the Ha 
line was ~ 100 times brighter than the Lya line, it would still be 
too faint to be detected alone in the 5.8 /mi IRAC band to the 
sensitivity achieved by the SWIRE data. 

3.2. The sample 

Our sample consists of 8 objects listed in tableland shown in 
Fig. [2] One has 7YB1060 - J ~ and therefore does not qualify 
as an emission line object, and is instead identified as a T-dwarf 
candidate (see section [J.3.5| l. Only 5 objects have 7YB1060 - J < 
and therefore qualify, a priori, as emission line objects, while 
two other objects have 7YB1060 fluxes fainter than the detec- 
tion limit in J, and therefore cannot be surely identified as line 
emitting objects. Therefore, from the six brightest objects of the 
original sample of eight selected without using the J magnitudes, 
five seem to be line emitters. With the same success rate of 5/6 
the two faintest objects should therefore also be line emitters and 
it is therefore reasonable to keep them in the final sample, how- 
ever flagging them as less secure than the other candidates. 

We also report in table [2] the lower limits of the restframe 
Equivalent Widths (EW) derived from the photometric data, de- 
fined as: 
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EW nst = 



' /a,NB1060 X A' 



2 

/VB1060 



-0.5 



JVB1060 



1+Z 



(6) 



i _n o — 1 

where is the observed flux density in ergs s cm A at 
the wavelengths of the NB1060 and J filters and A/Ijvbio60 i s tne 
width of the 7YB1060 filter (100 A). It is assumed that the UV 
continuum is completely extinguished below the Lya line, and 
therefore contributes to the NB1060 flux, in average, over only 
half of the filter spectral width. A spectral energy distribution 
/ v = const, is assumed. Assuming fx = const, would lead to 
EW values approximately twice as large. Six out of seven of our 
LAE photometric candidates are not detected in the J band and 
we therefore use the detection limit in this band, deriving in turn 
lower limit EW values. We note that LAE#6 and LAE#7 have 
positive EW values despite the fact that their NB1Q60 magni- 
tudes are fainter than their J magnitudes. 

Samples of emission line selected galaxies are nominally de- 
fined in terms of the limited equivalent width sampled by a par- 
ticular survey. For example, Taniguchi et al. ( 2005 ) present a 
sample of 9 spectroscopically confirmed LAEs at z = 6.5 with 
EW values EW obs > 130A or EW KSt > 17 A. Of our sample of 
candidate z = 7.7 LAEs, the faintest certain line emitters (e.g. 
LAE#5) presents NB1060 - J < -0.3 which corresponds to an 
EW limit -EWobs > 80A or EW iest > 9A. Considering that in all 
but one case all the EW values are lower limits, the lower range 
of EWs sampled by our observations is comparable to that of 
other studies. Within the practical limitation of matching the se- 
lection criteria of two different surveys, the two populations of 
LAEs revealed by Tani guchi et al.| ( |2005[ ) and the current study 
are therefore approximately equivalent in terms of the EW sam- 
pled. 

However, the z = 7.7 LAEs presented in this paper are 
selected to be 7YB1060 excess sources at a lower significance 
level than the Taniguchi et al. ( 2005 \ LAEs, and in addition our 
sources are not confirmed spectroscopically. Therefore, when 
comparing the LF properties of the z — 7.7 LAE candidates to 
confirmed LAE sources at z = 6.5 we must include an assess- 
ment of the unknown sample contamination. 



3.3. Possible sources of contamination 

Known astronomical objects such as extremely red objects or T- 
dwarfs can potentially satisfy the optical dropout selection and 
therefore possibly contaminate our sample. We examine various 
such examples in this section, along with artificial sources of 
contamination. 

In the discussion which follows we will make use of figure [3] 
which shows the 7YB1060 - Ks versus 7YB1060 - J colors of the 
candidates together with other astrophysical objects. 

We used the template spectra (without emission lines) de- 
scribed in Ilbert et al. (2009). We then arbitrarily redshifted them 
in the redshift range [0-8] and we added arbitrary reddening val- 
ues E(B - V) in the range [0-5], generating in total more than 
100,000 spectra. We then applied our selection criteria (equa- 
tion^, computing for the remaining spectra the NB1060-J and 
ATB1060 - Ks colors. The envelope of the points corresponding 
to galaxies at redshifts < 6 (respectively > 6) is indicated by the 
dark (resp. light) grey zone in figure [3] 



* Brown dwarfs 
□ TDW#1 

• LAE#1 

. LAE#2,3,4,5,6,7 

1=1 Starbursts (z>6) 

ivj Galaxies {all types z<6) 

— Color limit for [Oil] emitters at z=1.8 
Color limit for [01 1 1] emitters at z-1 .1 

— Color limit for Ha emitters at z=0. 61 
Selection criteria: 

u'- NB1060 > 2.7 
g' - NB1060 > 2.9 
r' - NB1060 >2.6 
i' - NB1060 > 2.2 
z' - NB1060 >1.3 
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Fig. 3. 7YB1060 - J and 7YB1060 - Ks color-color diagram. The 
filled square symbol corresponds to LAE#1, the filled circles to 
LAE candidates #2 to #7, and the open square to the T-dwarf 
candidate. Photometric errors are represented by the error bars 
or arrows depending on whether the objects are detected or not 
in the J and/or Ks bands. Star symbols correspond to L and T- 
dwarfs (see section 3.3.5 i. The grey areas correspond to the col- 
ors of z > 6 starbursts and z < 6 galaxies with arbitrary red- 
dening values E(B - V) in the range [0-5] that satisfy the color 
selection criteria used in this work. The template spectra used 
to compute the colors are described in Ilbert et al. ( 2009 1 and 
are without emission lines. When adding an emission line to 
the spectra, the points move to the left of the plot parallel to a 
line of slope 1. The corresponding lines drawn from the bluest 
7VB1060 - Ks datapoints at redshifts 0.61 (blue), 1.1 (green) and 
1.8 (red) are indicated. Emission line galaxies at these redshifts 
are located above these lines. 



3.3.1. Electronic crosstalk 

The WIRCam detectors suffer from relatively strong electronic 
cross-talk. The main effect consists in the appearance of ghost 
images every 32 rows or columns around bright and saturated 
stars. Three types of electronic ghosts have been identified: pos- 
itive, negative and 'edge' ghosts, the latter consisting of spot im- 
ages positive on one edge and negative on the other edge. The 
pattern of these electronic ghosts follows the sky on the im- 
ages since it is directly associated with (bright) sky objects. Only 
the positive ghosts are likely to generate false candidates. They 
are however easily recognizable since they are distributed along 
columns with a fixed pattern originating from the brightest stars. 
Median filtering every other 32 detector rows - corresponding 
to the number of amplifiers - allows one to highlight the ghosts 
while removing the real objects. This allows one to easily iden- 
tify most of the ghosts present in the images and to ignore them 
at the source - this is what was done and most of the ghosts did 
not contaminate our initial samples of candidates. After careful 
further investigation, 2 suspicious objects were discarded and 
accounted for as electronic ghosts for presenting several similar- 
ities with the pattern of brighter ghosts. 
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Table 2. Table of the z~ 1.1 LAE and T-dwarf candidates. 



Id. 


MR] nfiO 




SNR I'A/Rl 0(S01 


j 






u 




o i v i\y 1 1 f 


Ks 


Cj VV \f\ ) 


LAE#1 


24.0 


0.08 


14 S 




0.16 


6.7 


24.7 


0.3 


4 


>24.7 




LAE#2 


24.3 


0.17 


6.5 


>25.0 






>24.7 






>24.7 


>16 


LAE#3 


24.6 


0.15 


7.2 


>25.2 






>24.7 






>24.8 


>15 


LAE#4 


24.8 


0.19 


5.8 


>25.2 






>24.7 






>24.8 


>11 


LAE#5 


24.9 


0.2 


5.5 


>25.2 






>24.7 






>24.8 


>9 


LAE#6 b 


25.1 


0.19 


5.9 


>25.0 






>24.7 






>24.7 


>5 


LAE#7 b 


25.1 


0.22 


4.9 


>25.0 






>24.7 






>24.7 


>5 


TDW#1 C 


24.3 


0.12 


9.4 


24.2 


0.15 


7.3 


>24.7 






>24.7 





a Restframe 

b These two objects are not categorically identified as line emitting objects, but are still probably LAEs, see text 
c This object is not formally part of the sample because it is likely a late type T-dwarf, see text 



LAE#1 LAE#2 LAE#3 LAE#4 LAE#5 LAE#6 LAE#7 TDW#1 




Fig. 2. Thumbnail images of all candidates in the final sample listed in table |2| Object TDW#1 is displayed for reference but is not 
part of the LAE sample (see text). Objects Id's and photometric bands are indicated. 
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3.3.2. Persistence 

Another well-known effect of the IR detectors is that pixels il- 
luminated by bright and / or saturated stars in one image con- 
tinue to release electrons long after the illumination has stopped. 
This generates fake objects at the positions once illuminated 
by bright stars previously during the night. These fake sources 
remain fixed on the detector and therefore do not follow the 
sky during the dithering pattern. In principle they are removed 
by sigma clipping or min-max rejection when the images are 
stacked, however faint residuals may remain. Indeed a pattern of 
faint objects reproducing the pattern of telescope offsets was ob- 
served around the brightest stars in the image, generating false 
candidates which could be easily removed. 

3.3.3. Noise 



Table 3. Extremely Red Objects - A^B1060, Ks magnitudes and 
size 



Following the approach from |lye et al. (2006i, we have ~ 10 6 
1 .5" (diameter) circular apertures in our NB data. Since all of our 
candidates have SNR ^ 5, and assuming a gaussian distribution 
of the noise, the probability of false 5cr events is ~ 0.3. This is 
admittedly a crude analysis which does not take into account the 
fact that the noise properties of the stacked and resampled NB 
image deviate from a gaussian distribution. If contamination by 
noise might possibly take place at very low level close to the 
detection limit, noise certainly cannot be a plausible source of 
contamination for higher SNR objects. 

3.3.4. Transient Objects 

At the flux limit of the survey, distant supemovae can be visible 
for several weeks, and therefore be a potential source of contam- 
ination. 

We computed the expected number of Type la and Type II su- 
pemovae that would be visible in our narrow-band WIRCam im- 
ages, by using the same method presented in |Cuby et al.| ( |2007] l. 
For a limiting magnitude of 24.8 corresponding to one year of 
data (see table [TJ, we find that ~ 3 supernovae can be present 
in the area covered by our data. While contamination by SNe 
is therefore probable in individual one-year stacks, such objects 
are automatically removed from our final list of candidates be- 
cause of the condition that they be present in both 1-yr images. 
Similarly, stacking of data acquired over long time spans au- 
tomatically removes point-like slowly moving solar system ob- 
jects. 

3.3.5. T-dwarfs 



Using the |Tinney et al.| ( |2003| ) spectral type vs. absolute magni- 
tude relations we infer that we could detect T-dwarfs from 300 
to 1000 pc, depending on spectral type, from the coolest to the 
warmest. Considering the high galactic latitude of our field, this 
extends our sensitivity to T-dwarfs far beyond the Galactic disk 
scale height. Truncating to a Galactic disk scale height of 350 pc 
applicable to the population of T-dwarfs ( |Ryan et al.|2005| l, we 
derive a sampled volume of ~ 400 pc 3 . Considering a volume 
density of T-dwarfs of a few 10~ 3 pc~ 3 , we expect no more than 
one T-dwarf in our field. At a couple of hundreds of parsecs from 
the Sun the proper motion of these objects would not be detected 
over a one year timescale. 

We used the public library of L and T-dwarfs spectra com- 
piled by A. Burgasser (http://web.mit.edu/ajb/www/tdwarf) to 
compute the NB1060 - J colors expected for these objects. 
Including T-dwarfs as late as T8 (for which NIRC spectra are 



Id 


NB 1060" 


Error 


Ks* 


Error 


Size" 


ERO#l 


25.1 


0.4 


22.5 


0.1 


3.3 


ERO#2 


24.2 


0.3 


23 


0.1 


1.9 


ERO#3 


24.2 


0.3 


22.5 


0.15 


1.3 



11 MAG_AUTO as given by Sextractor 
b FWHM in arcsec in the Ks band 



available), the colours satisfy (see figure [3]) : 

(NBIQ60 - ^T-dwarfs > 



(7) 



One of the brightest candidates detected in the J band has 
AfB1060 - / colors satisfying this criterion and is therefore clas- 
sified as a late type T-dwarf (TDW#1). The two objects LAE#6 
and #7 have A^B1060 - J upper limit values also consistent with 
late type T-dwarfs. However, because (i) these are only upper 
limits (ii) we are not expecting many T-dwarfs in our data (see 
section 3.3.5 1 and (iii) these two objects are likely to be line 
we assume in the following that only 



emitters (see section [3T2] > 

TDW#1 is a T6 to T8 T-dwarf. We show in section [3381 that it 
could also be, in principle, a high-redshift Lyman Break Galaxy, 
but this does seem less likely. 

3.3.6. Extremely Red Objects 

The extremely red objects (EROs) are usually defined by their 
R-K color, e.g. _ ^ab ~ 3.4, possibly with additional color 
criteria (Cimatti et al. 2002), and their fluxes increase towards 
longer wavelengths. They are generally identified as either pas- 
sively evolving, old elliptical galaxies, or dusty starbust galaxies 
(|Pierini et aL|2004[ |Bergstrom & Wiklind||2004|). Despite their 



faintness in the optical bands, the vast majority of the ERO pop- 
ulation present in our data are detected in the r', i' or z' bands, 
and therefore not selected as LAE candidates. In practice, only 3 
objects which passed our initial selection criteria were identified 
as EROs based on their bright red A^B1060 - Ks colors, and the 
three of them are spatially resolved. Their Ks magnitudes and 
sizes are given in table [3] After removal of these 3 objects from 
our sample, none of the remaining objects are detected in the 
Ks band. The Ks band data, although of limited depth, do there- 
fore provide a reasonably robust selection tool for discriminating 
EROs from LAE candidates. 



3.3.7. Low redshift Emitters 

As shown in Eq|4] our candidates exhibit a very strong color 
break of about three magnitudes between the optical part of the 
spectrum and 1.06 //m. Contamination could occur from pecu- 
liar emission line objects such as strong star forming, low metal- 
licity galaxies with an emission line redshifted in the NB filter 
and an underlying continuum so faint that it would remain un- 
detected in any of the optical broad band filters. The most likely 
sources of low redshift contamination are from Ha emitters at 
z = 0.61, [OIII] emitters at z = 1.1 and [Oil] emitters at z = 1.8. 
We first make use of figure [3 to evaluate the EW of the emis- 
sion lines required at these redshifts to contaminate our sample. 
Such emission line galaxies are located above the colored lines, 
and for their near-IR colors to be consistent with our data (to the 
extreme left of the plot) would require a contribution of the emis- 
sion lines to the A^B1060 flux of several magnitudes, equivalent 
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to restframe equivalent widths of several hundreds or thousands 
of Angstroms. We now discuss each source of contamination in 
turn. 

Ha emitters at z = 0.61 

To estimate the number of Ha emitters present in our WIRCam 
image we use the Ho- luminosity function of |Tresse et al.| {2002 ) 
without reddening correction. To our detection limit, and assum- 
ing that the NB flux is dominated by the Ha line flux, we de- 
rive that we have ~ 300 Ha emitters in our filter and field of 
view in the redshift interval [0.607-0.623]. The vast majority 
of these emitters are bright in the optical and therefore not se- 
lected. Indeed, using the Ilbe rt et aT] ([2005 ) luminosity functions 
in the restframe UBV filters and in the redshift bin [0.60-0.8] 
we estimate the limiting magnitude providing 300 objects in the 
comoving volume sampled by the Ha line through the /VB1060 
filter. We obtain magnitudes of 25.8, 26 and 25.6 corresponding 
approximately to the r'i'z' filters at redshift 0.6, i.e. more than 
1.5 magnitude below the limiting magnitudes of the CFHT-LS 
in the r' and /' filters. No normal z — 0.61 galaxy spectral energy 
distribution can therefore contaminate our sample. 

In the extreme case of a pure line emission spectrum, the sen- 
sitivity limits in the r' and i' bands correspond to [Oil] and [OIII] 
flux limits of 3 x 10~ 18 ergs s _1 cm" 2 and 2 x 10~ 18 ergs s _1 cm" 2 
respectively. Assuming an intrinsic Balmer decrement of 2.8 for 
case B recombination, this would correspond to [OII]/Hj8 and 
[OIII]/HyS ratios respectively below 1.0 and 0.71. In the sample 
of galaxies between redshifts 0.4 and 3 presented in Maier et al. 
(2006 ), no objects meet these criteria simultaneously. All objects 
with low [OIII]/H/3 ratios have strong [OII]/[OIII] ratios, and ei- 
ther of the two [Oil] or [OIII] lines should therefore be detected. 

In conclusion of this analysis, we argue that contamination 
by z — 0.61 galaxies is unlikely to bias significantly our sample. 

[OIII] emitters at z — 1.1 

At redshifts 1.12, similarly to the case above, the vast major- 
ity of the [OIII] emitters in the comoving volume sampled by 
the NB filter will be detected in the optical bands. We use Fig. 
13 of |Kakazu et al.| ( |2007| l to estimate at about 100 the num- 
ber of [OIII] emitters in our NB image, assuming no dramatic 
evolution in the [OIII] LF between redshifts 0.83 and 1.1 and 
considering that the line emission dominates the TVS 1060 flux. 
Contamination in our sample could only take place from low lu- 
minosity, high EW [OIII] emitters, unlikely to represent more 
than a handful of objects. Even so, for [Oil] not to be detected in 
the i' filter would require a [OIII]/[OII] ratio of 4 or higher at the 
detection limits of the ;' and NB images. In the data presented in 
Maier et al. (2006) at redshifts between 0.4 and 3, no more than 
5% of the galaxies have such high values. In total, it is therefore 
unlikely that our sample be contaminated by [OIII] interlopers. 

[OH] emitters at z — 1.8 

Using the [Oil] luminosity function of Rigopoul ou et al.| ([2005 ) 
we estimate the number of [Oil] emitters in our NB image at 
~ 300 objects. The [OIII] and Ha lines at redshift 1.84 fall be- 
tween the atmospheric windows between the J and H bands for 
[OIII] and between the H and Ks bands for Ha, and therefore 
do not contribute to the near-IR fluxes in these bands. Using the 
|Kennicuft| ( ] 1 998[ ) relations between the UV continuum and [Oil] 
luminosities we derive a rough estimate of the optical magni- 
tudes expected for [Oil] emitters at 1.06 /jm. At the flux limit 
of our data, we get m£5 ~ 25.5, which is 2 to 3 magnitudes 
brighter than the limiting magnitude of our optical data. Even 
with a large scatter around this value, we expect that the vast 
majority of [Oil] emitters should be readily detected in the op- 



tical bands. Dusty starbursts may obviously have much fainter 
optical magnitudes, but such objects would fall in the category 
of Extremely Red Objects, which, as explained above, can be 
discarded from their brightness in the Ks band. Very strong, and 
unusual [Oil] EW would be required for dusty [Oil] emitters to 
be selected as candidates without being detected in the Ks band, 
and such objects would likely be spatially resolved. 

We note that Tanig uchi et al.| (2005 ) suggest that the few line 
emitters in their sample of z — 6.5 LAE candidates resisting a 
definitive identification as LAEs could be [Oil] emitters. Some, 
if not all, of these [Oil] emitters would probably be detected in 
the Ks band with the same detection limit as ours. We therefore 
argue that contamination by [Oil] emitters in our survey is likely 
to be low and unlikely to contaminate a large fraction of our 
sample. 



3.3.8. High-redshift LBGs 

Bright high-redshift Lyman Break Galaxies (LBGs) can be de- 
tected in the /VB1060 filter through their UV continuum. For this 
to happen, the redshift shall be smaller than our target value of 
7.7, but high enough for these objects to escape detection in the 
optical images, irrespective of the presence or not of Lya emis- 
sion. See |Cuby et al.| (2003 i for such an example. 

To estimate the possible contamination by these bright, high- 
z UV sources, we use the |Bouwens et al.| ([2009 ) UV LF at z ~ 
6 and ~ 7. As a worst case scenario we consider two redshift 
ranges: the [6.0-7.0] range for which we use the z = 5.9 UV LF 
and the range [7.0-7.7] for which we use the z = 7.3 UV LF. I 
band dropouts may fail detection in the z band while being de- 
tected in the 7VB1060 filter. While the number of objects is «1 
in the second redshift range, it is ~ 3 in the first range. We con- 
sider this number as a significantly overestimated number, for 
the reason that the simple calculation above uses the luminos- 
ity function at z = 5.9 which applies to the lower bound of the 
redshift range and for which the luminosity is brighter. Had we 
used the z - 7.3 LF to match the [6.0-7.0] range, we would have 
found 0.2 objects. 

We note that these objects would - but for their possi- 
ble detection in the z' band - pass all of our selection cri- 
teria, but could be mistaken as late type T-dwarfs (see sec- 
tion 



3.3.5 Interestingly, one of the brightest candidates in our 



sample (TDW#1), although primarily thought to be a T-dwarf, 
could also be a (bright) LBG. 



3.3.9. Conclusion 

We have analyzed various possible sources of contamination for 
our sample. We note that the magnitudes of our candidates are 
well distributed, and do not cluster towards the faint end of the 
luminosity range probed by our survey. This is in itself a sanity 
check demonstrating that we are not sensitive to a sudden in- 
crease of the false alarm rate towards faint fluxes. We note that 
we have made use of very robust selection criteria to select our 
candidates, consisting of very strong color breaks between the 
optical and the near-IR (~ 3 magnitudes), and rejecting EROs 
from their bright fluxes in the Ks band. We argue that our se- 
lection criteria are comparable to the criteria used in other LAE 
or LBG studies and we are therefore confident in the reliability 
of our sample. We however cannot completely rule out contami- 
nation by one or the other sources identified above, in particular 
artifacts and / or [Oil] emitters. In the following, we will evalu- 
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ate the impact of partial contamination of our sample, at the level 
of a couple of objects. 



4. Discussion 

4.1. Variance 

The variance on the number of objects in our sample is due 
to Poisson errors and to fluctuations in the large scale distri- 
bution of galaxies. Various models exist in the literature to ac- 
count for the effects of cosmic variance. Trenti & Stiavelli ( 2008 ) 
have developed a model which is offered as an on-line 'cosmic 
variance calculator'. Assuming a one-to-one correspondence be- 
tween dark halos and LAEs, we obtain from this model a value 
of ~28% for the cosmic variance in our data. 

This result however strongly depends on the assumptions 
used for the level of completeness and contamination factor in 
our sample. In view of the limited number of objects in our sam- 
ple and of the large comoving volume (~ 6.3 x 10 4 Mpc 3 ), our 
results are probably limited by Poisson noise 38% for 7 ob- 
jects - more than by clustering variance. We note however that 
variance due to clumpy re-ionization is ignored and may also 
contribute to the total variance. 



4.2. On the Lya Luminosity function atz- 7.7 

From our data we can derive constraints on the Lya luminos- 
ity function of z — 7.7 LAEs. We first apply a corrective factor 
when converting the A^B1060 magnitudes to Lya fluxes. From 
the J magnitude of object LAE#1 we infer that the Lya line con- 
tributes to ~ 70% of the JVB1060 flux, a valu e similar to the 
averag e value observed for the z = 6.5 LAEs of Taniguchi et al. 
(2005 i and which corresponds to an EW bs of ~ 110 A in the 
observed frame. We adopt this line to continuum ratio in the fol- 
lowing to derive the Lya fluxes from the A^B1060 magnitudes, 
adding a 0. 1 magnitude rms error to account for the dispersion 
of this ratio between objects, consistent with the dispersion of 



Table 4. Best fit Schechter LF parameters for a = - 1 .5 



the EW values of |Taniguchi et al.| ( |2005| l. Clearly, deeper J band 
imaging or spectroscopy would be required to estimate this frac- 
tion on a case by case basis for each object. 

To discuss the Lya luminosity function derived from our 
sample we first fit a Schechter function 4>(L) to our data, where 
<D(L) is given by: 



, / L \ u I L\dL 
*(L)dL = 0*(-) exp(--)- 



(8) 



Considering the scarcity of datapoints in our sample, we do 
not attempt at fitting the 3 parameters of the Schechter func- 
tion. Following typical values adopted by |Ouchi et al.| ( [2008 1 and 



Kashikawa et al. ([2006 ) for the faint end slope a of the luminos- 
ity function, we use a = - 1 .5 and derive <&* and L* by a simple 
X 2 minimization. We note that there may be other functions more 
representative of the Lya LAE LF at high redshifts. For instance, 



Kobayashi et al. ( 2007 1 derive numerical LFs from models of 
hierarchical galaxy formation and of the escape fraction of Lya 
photons from host galaxies. These LFs differ significantly from 
a Schechter function. However, for the sake of comparison with 
previous work, we keep the analytical Schechter formalism. 

We initially assume that all of the 7 candidates of the full 
sample are true z = 7.7 LAEs, and derive the corresponding 
LF parameters. To evaluate the impact of sample contamination 
on the results, we then consider situations where only 4 candi- 
dates among the 7 of the sample are real. As shown earlier in 



Redshift 


log(L*(ergs ')) 


log(<D*(MpcT j )) 


7.7" 


43 +() 1 


T Q+0.5 


7.7 b 


An -2+0.6 

-Q-6 




7.7 C 


42.9 + f 2 


7.7 d 

6.5 (1) 


42 5 + ° ^ 
426+0.12 


-lof 

T oo+b'.!4 


5.7 (2) 


42 8 + ^ : ' 6 

HZ "°-0.16 


■2 i i +0.29 
J.ll_ a31 



a Full sample of 7 candidates 

b Mean of the 20 bright samples of 4 objects among 7 
c Mean of the 10 intermediate samples of 4 objects among 7 
d Mean of the 5 faint samples of 4 objects among 7, see text 
References. (l) [Kashikawa et al.| ( |2006) ; (2) |Ouchi etaLl f2008 1 



this paper, despite the robustness of our sample, we cannot com- 
pletely rule out contamination by an instrumental artifact or a 
low redshift peculiar object. We therefore conjecture that at least 
4 objects in our sample must be real z = 7.7 LAEs, and evalu- 
ate the impact on the Luminosity Function parameters with such 
reduced samples. To do this, we consider all combinations of 4 
objects from among the 7 in the sample, and compute for each 
subset the best fit parameters using a Schechter function. The 
results of the fits for the full sample and for the 35 sub-samples 
are shown on figure [4] which shows that the fits of the 35 sub- 
samples of 4 objects naturally divide into 3 different categories: 

- a bright category of 20 samples which all contain the bright- 
est object (LAE#1) 

- an intermediate category of 10 samples which do not contain 
the brightest object but which do contain the second brightest 
object (LAE#2) 

- a faint category of 5 samples containing none of the two 
brightest objects 

For each sample we derive the best fit Schechter LF parame- 
ters for a — -1.5 and we derive the average parameters, reported 
in table 4] for each of the three categories defined above. The cor- 
responding average LFs for each category are shown as dashed 
lines on figure [4] We note that the full sample LF (plain black 
line) corresponds very closely to the LF of the sample of the 
four brightest objects from the bright category. We also note that 
by removing three objects from the full sample while keeping 
the brightest in the bright category, we artificially enhance the 
L* parameter, or alternatively reduce the O* parameter of this 
category. In consequence the full sample LF is probably more 
representative of the situation where the brightest object is real 
than the average LF of the bright category. 

To further illustrate our results in the light of the LAE LF 
at lower redshifts, we plot in figure [5] the error contours for the 
full sample and the faint category together with the z — 6.5 and 
z — 5.7 LFs from Kashikawa et al. (2006} and |Ouchi et al.| 



(2008 1. The errors for the faint category are dominated by the 
fitting errors for each of the five LFs in the category, and to ac- 
count for the dispersion between samples we simply add to the 
fitting errors the deviation between the two most extreme LFs 
in the sample. The full sample LF would indicate an evolution 
between z — 7.7 and z — 6.5 opposite (in L* and <£*) to the evo- 
lution between z = 6.5 and z = 5.7 at the 2<x confidence level. 
Conversely, the faint category LF would be consistent with this 
evolution and with the z = 6.96 datapoint of lye et al. (2006). 
In other words, for our data to be consistent with other work 
requires that both of our brightest objects are not real LAEs. 
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Fig. 4. Cumulative Luminosity Functions (LFs) with a = -1.5. 
Up: Luminosity function derived from the full sample. The data 
(triangles) are not corrected for completeness and a factor of 
70% has been used to convert the 7YB1060 fluxes into Lya fluxes. 
The plain line is the best fit Schechter function through the dat- 
apoints. The z = 5.7 (|Ouchi et al.|(|2008| l, long dashed line) and 
the z = 6.5 (Kashikawa et al. (2006), short dashed line) LFs are 
also indicated. Each point in the sample and its aperture photo- 
metric errors, augmented by the photometric calibration errors 
and dispersion of the conversion from 7YB1060 magnitudes to 
Lya line fluxes, define the luminosity bins and the horizontal 
error bars. The vertical error bars represent the Poisson noise 
associated to the number of candidates. The square point cor- 
responds to the z = 6.96 LAE of by lye et al. ( 2006| l. Bottom: 
The shaded color areas represent the range of LFs in each of the 
three categories described in the text, and the dashed lines rep- 
resent the associated average LFs. Bright category: green area 
and dot-dashed line ; intermediate category: blue area and short- 
dashed line ; faint category: magenta area and long-dashed line. 
Also plotted is the LF at z — 6.5 (Kashikaw a et al.| (2006), plain 
red line) and the full sample z = 7.7 LF (this work, plain black 
line). The square point is the z - 6.96 LAE of |Iye et aL (2006) 
and the triangle is LAE#1 (this work). The shaded grey areas to 
the bottom and left of the figure represent the regions where the 
z = 7.7 LF would lie if none of our candidates were real LAEs. 
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Fig. 5. Error ellipses for the best-fit Schechter parameters <1>* 
and L* for a = -1.5. The solid and dotted line ellipses are re- 
spectively the 68% and 95% confidence levels 
. Are shown the error contours of the Schechter parameters for the full 
sample (black), the faint category (green), the z = 6.5 LF (Kashikawa 
|et al. |20 06) (red) and the z = 5.7 LF ( |Ouchi et al.|2008) (blue). 



Only spectroscopic confirmation will allow to draw firmer 
conclusions, which will still be based on small numbers and 
therefore subject to large uncertainties. Finally, we note that the 
analysis performed in this section would remain qualitatively 
and quantitatively similar had we assumed that only 3 of our 
candidates were real instead of 4. 



4.3. Implications 

We used the model from Kobayash i et al.| ( [2007| l to estimate the 
ionization fraction of the IGM at z — 7.7 from our constraints on 
the Lya LAE LF. This model produces LFs for different values 
of the IGM transmission to Lya photons (7^™*) used as a global 



parameter. The Lya attenuation by the IGM is a complex process 
originating in the damping wings of the Lya line and involving 
the neutral fraction of hydrogen jchi and dynamical models of the 
local IGM infall towards the LAEs ( |Santos|2004l |Dijkstra et al.| 



2007). Within this model the conversion factor from 7^™ to Xhi 



is therefore highly sensitive to the local IGM density and veloc- 
ity, and may not be representative of the average IGM situation. 
Using this model, to best fit our LFs within the range of observed 
luminosities, we derive values ranging from ~ 0.7 for the 

faint category to 1.0 for the full sample. ~ 0.7 corresponds 



to xhi ~ 0.3 in the model of Santos (2004 1 for a given redshift of 
the Lya line with respect to the systemic velocity of the galaxy. 
This x m value is approximately similar to the one derived from 
the LAE Lya LF at z = 6.5 ( |Kobayashi et al.|2007) . 

Considering the high level of uncertainty on the z = 7.7 LF 
derived from our results and on the re-ionization models, we 
simply note here, in parallel to our earlier conclusions on the 
LF, that if one or both of our brightest objects is real, a low frac- 
tion of neutral hydrogen is inferred (w 0), in contradiction with 
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earlier reports of an increasing fraction above z ~ 6. Even if both 
of the brightest objects are not real but if a reasonable fraction of 
the faint objects is real (our faint category), the Kobayashi et al. 
( |2007| l model infers a still moderate neutral fraction of hydro- 
gen. 

Finally we note that many other models are available in the 
literature which predict the evolution of the LF of high-z LAEs 
(Baugh et al.][2005] |Le Delliou et al. 2006, Cole et al.|[2000 



Mao et al. 



Furlanetto 



2007 



2008 



Thommes & Meisenheimer 2005 , Mesinger & 



, see also |Nilsson et al.| ( |2007[ ) for a comparison 
of some of these models. These models do use various ingredi- 
ents into the simulations, and discussing our results in the light 
of each of these models is beyond the scope of this paper. For the 
sake of visual comparison, we plot in figure [6]our results corre- 
sponding to the extreme full sample and faint category compared 
to some of these models. 



LF range of the full sample 



LF range of the faint sample 




5xl0 4z 10 43 
L(Lya) (erg s~') 



Fig. 6. Cumulative Luminosity Functions corresponding to our 
full sample (plain red thick line) and faint category (long blue 
dashed thick line). The range of luminosities sampled by the data 
for both samples are indicated by the arrows. Thin lines are z~8 
LFs from various models: Baugh et al. (2005) (plain line), Mao 
[eTaTI p007l > (dotte d line), |Thommes & Meisenheimer| @005 ) 
(short-dashed line), Kobayashi et al. ( 2001) (color long-dashed 



lines for various IGM Lya transmissions T^ 1 ) as indicated. The 
square point is the z = 6.96 LAE of lye et al. (2006) 



5. Conclusions 

We have searched z = 7.7 LAEs in a deep narrow-band image 
at 1.06 jt/m obtained with WIRCam at CFHT, totalling 40 hrs 
of integration time and covering 390 arcmin 2 and sampling a 
comoving volume of 6.3 x 10 4 Mpc 3 , down to a limit in Lya 
luminosity of 8.3 X 10" 18 ergs s cirT 2 . 

Using deep visible data of the field, we have selected LAE 
candidates presenting a strong color break of up to 3 magnitudes 
between the visible data and the iVB1060 filter. We have obtained 
a sample of seven carefully selected candidates. We have ana- 
lyzed all sources of contamination that we could think of, and 
argued that contamination is unlikely to affect all of our candi- 
dates. 

We found that the Lya LAE luminosity functions derived 
from our photometric sample, within the limitations of the 



Schechter formalism and with a fixed slope parameter a = 
-1.5, would contradict the evolution in luminosity found by 
|Kashikawa et al.| (|2006) between z = 5.7 and z = 6.5 at the lcr 
to 2cr confidence level if only one of our two brightest objects is 
real. Only spectroscopic follow-up of objects in our sample will 
allow to derive firmer conclusions. 

Using models of Lya LAE LFs available in the literature, 
and contingent upon their reliability, we infer from our results 
that the fraction of neutral hydrogen at z — 7.7 should be in the 
range [0.0-0.3]. 
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